FREELY FORMING GROUPS: TRYING TO BE RARE 



MICHAEL BAAKE, UWE GRIMM, AND HARALD JOCKUSCH 

Abstract. A simple weakly frequency dependent model for the dynamics of a population 
with a finite number of types is proposed, based upon an advantage of being rare. In 
the infinite population limit, this model gives rise to a non-smooth dynamical system that 
reaches its globally stable equilibrium in finite time. This dynamical system is sufficiently 
simple to permit an explicit solution, built piecewise from solutions of the logistic equation 
in continuous time. It displays an interesting tree-like structure of coalescing components. 



1. Introduction 

Imagine a large, but finite population of N individuals, with iV fixed. Imagine further 
that they are divided into M disjoint groups, of type i and size n i > 0, 1 < i < M, so that 
n 1 + . . . + n M = N . Let us assume that there is an advantage in belonging to a smaller group, 
but that changing the group is only reasonable if individuals from different groups meet. As 
a justification for this setting, we envision that each individual might only know the size of 
its own group, but not necessarily the size of any other one. Consequently, a comparison 
requires the exchange of information. For simplicity, we assume honesty in this process. 

To specify the dynamics, we assume that, at a fixed rate (which we may choose to be 1 
for simplicity), two individuals chosen at random from the entire population meet and act 
according to the following protocol. If both are from the same group, or from groups of the 
same size, no action is taken; otherwise, the individual from the larger group joins the smaller 
one, by changing type accordingly. We assume that the advantage depends on group size 
only, not on type. Note that a situation where n„- = n i + 1 is changed into n i = n„- + 1 is 
overall neutral, and also neutral from the point of view of the acting individual. 

In this short note, we consider the resulting dynamics in the deterministic limit as N — > oo, 
with a fixed number of types. This approach is appropriate because the protocol is determin- 
istic, and no extinction can occur in the finite size situation. Therefore, no stochastic effects 
of relevance are possible. Consequently, we shall look at the deterministic time evolution of 
the corresponding (discrete) probability distribution {p i | 1 < i < M} of the types. This 
setting is known as the infinite population limit (IPL), compare Ch. 11.2] for background 
material and fo r recent examples. For a finite population, p i = n i /N are the type 

frequencies. The model thus shows a frequency dependence, which is weak in the sense that 
only the signs of the differences p i — pj matter, but not their magnitudes. 

This approach leads to a simple, but rather interesting system of nonlinear ODEs, with 
discontinuous right-hand side. The latter property requires some care concerning the concepts 
of a solution and of an equilibrium, since the standard results of ODE theory do not directly 
apply. However, this will cause no problem in our case, where we shall see that the globally 
stable equilibrium, p 1 = . . . = p M = 1/M, is reached in finite time from any initial condition 
in the interior of the probability simplex (see below for details). 

Our simple example is illustrative in the sense that a biologically relevant, non-smooth 
dynamical system can be looked at and solved explicitly, without invoking the general theory 
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|5j or resorting to abstract results jHj- In fact, to derive the solution, one only needs a 
good understanding of the logistic equation in continuous time, compare p] Ch. 1]. In our 
multi-dimensional system, the solution curves of the various components display a tree-like 
coalescing structure. The corresponding coalescing times are the relevant time scales that 
would also show up in smooth approximations of this non-smooth dynamical system (where 
they appear as the characteristic times of the exponential closing- in of the components). 

The model is a toy example of game theoretic flavour, compare where a key ingredient 
is the use of non-local information (the group sizes). As such, it can be considered as a 
model of population dynamics Q] , but is rather different from the standard models of 
population genetics, compare 011]. As possible applications, one could think of population 
patches (spatial advantage), food specialisation (supply advantage), advertising strategies 
(promotional advantage) or name choosing (recognisability) , to name but a few. 

Similar models, and also more general ones, have been investigated in mathematical game 
theory. One early example is the ideal free distribution of Fretwell and Lucas in ecology jH] , 
which describes the spatial distribution of a population among a fixed number of resource 
patches. This is related to the evolutionary stable strategies of game theory, see ^ for 
a detailed discussion. Various dynamics, including imitation and replicator dynamics, are 
considered in this context, compare the excellent review by Hofbauer and Sigmund ^2] with 
its extensive bibliography. 

Even though our model can be seen as a special case of imitation dynamics, compare 
Sec. 8.1] and |121 Sec. 3.2], it results from a specific finite size model via the infinite population 
limit, and is thus fixed. Since we see this as a first step towards more realistic models including 
stochastic and finite-size effects, we find it slightly more natural to use the classic notions of 
dynamical systems rather than to formulate the model and its solution in the language of 
game theory (we shall give the translation below for comparison). 



2. The dynamical systems and their equilibria 



The reservoir of types, or state space, is {1, . . . ,M}, i.e., there are finitely many different 
states. In the IPL limit [HI El El - one considers the deterministic time evolution of probability 
vectors p = (p 1; . . . ,p M ) with^ > and YliPi = 1j where pi is the proportion of the (infinite) 
population in state i. For the model described above, with p = p(t), this gives the system of 
ODEs 



(1) Pm = y^^PmPn Sgn(p n 

n 

where sgn is the signum function, i.e., 



Pr. 



sgn(x) 



-1. 



x > 
x = 
x < 0. 



More generally, one could consider the ODEs 

(2) Pm = } ] PmPn vijPn ~ Pm) 

n 

where tp: [—1,1] — > M is an odd function (i.e., ip{— x) = —ip{x)) that is continuous, or (as 
sgn above) piecewise continuous with only finitely many jumps. In particular, <p(0) = 0. 
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In general, such discontinuities require solutions to be denned accordingly, e.g., in the sense 
of Filippov §4], thus referring to the well developed theory of ODEs with discontinuous 
right-hand sides. Fortunately, and not untypically for models with a biological context, one 
can introduce all ingredients required for our model in an elementary way. Moreover, one can 
make most results explicit, thus illustrating aspects usually obtained by qualitative theory. 

Let us first assume that tp is continuous. Then, the forward flow of the dynamical system 
© leaves the cone of positive vectors invariant, which follows from the observation that 
Pm(t) = implies p m (t) = 0, together with standard arguments from ^ Ch. 16]. Since 
ip(0) = 0, one also finds 



whence gj(Pi + • • • +%) = and total mass is preserved. In particular, the forward flow of 
© preserves the simplex of probability vectors, Vm '■= {p € M M | p% > and YliPi = !}• 
This is in line with the probabilistic interpretation chosen above. 

In an appropriate generalisation, this remains true for the dynamical system (^Q) with 
its discontinuous right-hand side. In general, this claim requires some care, and is usually 
substantiated by viewing the ODE Q within the scheme of so-called differential inclusions, 
where one considers equations of the form p n G F(t,p) with set-valued right-hand sides ^3 
Sec. 2], see also Sec. 3.3] for its appearance in game theory, e.g., in the context of the 
so-called best response dynamics. For our system (^Q), the function sgn(x) would simply be 
replaced by the set-valued function Sgn, defined by Sgn(x) = {sgn(x)} for x ^ together with 
Sgn(0) = [—1, 1], compare |13| Ex. 2.1.1]. Since our system is autonomous and well-behaved, 
it is then essentially straight-forward, following 13, Thms. 2.2.1 and 2.2.2], to establish the 
existence and uniqueness result for its solution in forward time. Fortunately, Eq. (^Q) permits 
a much simpler approach, based directly on the single- valued function sgn(x). 

Clearly, solutions of Q can no longer be expected to be differentiable everywhere. The 
starting point is then the class of absolutely continuous functions, which are differentiable 
almost everywhere. A solution of our ODE © is then a function of this class that satisfies 
© almost everywhere. As we shall see explicitly below, the solutions of Q are actually 
piecewise smooth, with only finitely many points of non-differentiability (coinciding with the 
coalescence points of components). More precisely, at the glueing points, the value of the 
previous segment provides the initial value for the next. It will always be evident that this 
construction yields the unique solution. 

In what follows, we shall only consider the dynamical system restricted to the probability 
simplex Vm- Moreover, we mainly consider initial values from its interior, because otherwise, 
in view of the right-hand side of Q|, we could start with a smaller state space right away, i.e., 
with a probability simplex of smaller dimension. In this sense, the restriction to the interior 
of Vm covers all cases, by suitable choice of M. 

The equilibria of our systems lfl |) or P |) certainly include the uniform distribution on 
{1, . . . , M} or that on any subset of it. These correspond to the centre of the simplex Vm or 
to the centre of some boundary of it, the latter effectively being a simplex Vm 1 with M' < M. 
Further equilibria can exist if <p(x) has zeros other than x = 0. However, we are primarily 
interested in stable equilibria, such as pi = l/M for ©. In fact, the latter is even globally 
stable, meaning that any initial condition from the interior of Vm will converge, under the 
forward flow, to this equilibrium, compare [HI Sec. 2.2] for a brief discussion of these concepts. 




m,n 
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Let us briefly expand on this point. Observing that both models (^Q) and © can be viewed 
as special cases of imitation dynamics in game theory (with the negative identity matrix 
being the payoff matrix, compare [111 Eq. 8.3]), one can derive that they possess a Lyapunov 
function, subject to certain conditions on the function <p. This can also be seen explicitly as 
follows. If we define f(t) := Yl m {Pm(t)) 2 , a simple double summation argument using © 
shows that 

(3) / = ~ y^PmPn (Pn ~ Pm) PiPn ~ Pm) ■ 

m,n 

Consequently, as all p m > 0, f(t) < if tp is a non-decreasing odd function (note that xip(x) 
is then even and > 0). 

If x = is the only zero of ip{x) and pit) a point in the interior of Vm, one has f(t) < 
unless p{t) is the centre of Vm- This establishes / as a strict Lyapunov function for the 
interior of Vm m these cases, see for details on this concept. This observation establishes 
the global stability result of the equilibrium point p 1 = . . . = p M = 1/M, both for and 
(j2J). The hierarchy of boundaries of Vm can be treated separately, by identifying them with 
appropriate cases of smaller dimension. 



3. Solution of the case M = 2 

Let us consider Eq. for M = 2. Setting p 1 = p and p 2 = q = 1 — p, it is clear that it 
now suffices to consider the single ODE 

(4) p = p(l — p) sgn(l — 2p) . 

If pit) < 1/2, this simplifies to p = p(l — p), which is the well-known logistic equation in 
continuous time, compare P3 Ch. 1]. It has the solution 

= , , with a- 



l + ae(*o-*) ' ' p(t ) 

If the initial condition of (j3J) is < pito) < 1/2, this formula also provides the solution we 
need, until p(t) reaches the value 1/2, whereupon the solution continues as p(t) = 1/2 — the 
globally stable equilibrium. As is not untypical of ODEs with discontinuous right-hand sides, 
compare 8, §15], this happens after a finite time, namely at 

h = t + log 1 ~ ^ = to + log(a). 

Similarly, if pit) > 1/2, Eq. © simplifies to p = —p(l —p). Provided that 1 > p(to) > 1/2, 
the solution now is 

- 1 

P ^ ~ 1 + ae {t-to) ' 

with a as before, until pit) hits 1/2 from above. This happens at time 

t 2 = t + log P(tp) = to-log(a). 
1 -p{to) 

In this rather simple case, q = 1 — p, and the complete solution is thus given in closed form, 
with one coalescence point at time t\ or t 2 , depending on the initial condition. If a = 1 (i.e., 
p(to) = 1/2), t\ = t 2 = to, and one is in the equilibrium from the very beginning. 
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4. Some comments on the general structure 

If M > 2, one can simplify the situation enormously by assuming, without loss of generality, 
that the initial condition is non-degenerate (meaning that all types occur) and ordered, so 
that 

(5) < p x < p 2 < . . . < p M < 1 . 

If the pi are all equal, we must have pi = 1/M, i.e., we are (and stay) in equilibrium. So, let 
us assume that at least one further inequality sign is proper, and that the leftmost position 
where this happens is between t and I + 1. In other words, 

< Pl = . . . = Pe < Pe+1 < . . . < p M < 1 . 

Since YljPj = 1> one then has J2jLe+\Pj = 1 — ^Pi> f° r an Y I < i < £■ Then, a short 
calculation with Eq. (0) shows that the time evolution of all pi with 1 < i < £ is identical, 
and given by the ODE 

(6) p = p(l - Ip) , 

as long as p e < remains true. This variant of the logistic equation has the solution 



e + PeV°-*) M p(t ) 

In general, the situation can be described as follows. Whatever the initial condition is, one 
can bring it to the standard form ©, by a permutation of the types. In forward time, the 
ordering then remains that way. Step by step, two or more neighbouring pi coalesce, all in 
finite time, until the equilibrium is reached (also in finite time). With increasing M, there is a 
growing number of different possibilities for the emerging coalescent trees of components (not 
to be mixed up with the result of the well-known coalescent process from population genetics, 
compare 0), which makes a closed formula for the solution cumbersome. The general 
picture, however, is rather intuitive, and will become evident from the explicit solution for 
M = 3. 



5. Solution of the case M = 3 
Let us consider our system (0) for M = 3 and assume 

< Pi < P 2 < P 3 < 1 

in order to exclude any degenerate situation. It is clear that we now have three different 
coalescent trees to distinguish, see Figure ^ 
The system of ODEs now reads 

(7) p 1 =p 1 (l-p 1 ), p 2 =p 2 (p 3 -p^ , p 3 = -p 3 (l -p 3 ) . 
With on = (1 — P i(to))/pi(to), the solutions p l and p 3 start as 

1 1 

( 8 ) = TT (t^t) ' Ps(*) = T~Z (t^) 

1 + a 1 e ( - t ° z > 1 + a 3 e^ t0 > 

while the solution for p 2 can be obtained from here by insertion and elementary integration, 



(9) P 2 (*)=P 2 (*o) 



(l + a 1 )(l + a 3 ) 



(1 + a 1 e(*o-*))(l + a 3 e( i - i °)) ' 
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0.2 0.4 0.6 



Figure 1. Examples of the non-degenerate classes of solutions for M = 3. 
The solutions {pi(t) , p 2 (t) , p 3 (t)) are drawn on top of each other, against time 
on the horizontal axis. Initial conditions at to = are, from left to right, 
(0.22,0.28,0.5), (0.2,0.3,0.5) and (0.2, 0.32, 0.48). The equilibrium (±, ±, ±) is 
reached at t = log(2) in all three cases. In the left (right) frame, the first 
coalescence happens at t = log(y|) (at t = log(^)). 



These solutions remain valid until p 1 meets with p 2 or p 2 with p 3 (whatever is first), or both 
(if they coincide). A simple calculation gives the coalescing times 



ti2 = t + log 1 + 



P2-P1 
Pi(Pi+P 2 ) 



and t 2 3 = t - log 1 



P3-P2 

P 3 (P2+P3) 



where the pi are to be read as Pi(to). 

If £12 = ^23; all three curves Pi{t) coalesce in one point, (§, §, §)• From here, the solution 
is then pi(t) = |, the globally stable equilibrium of this situation, see the middle example in 
Figure ^ This happens if and only if the initial conditions satisfy 



(10) 



P2 



3Pi(l - Pi) 
l + 3pi 



in addition to p 1 + p 2 + p 3 = 1. 

Otherwise, we have to distinguish the cases t±2 < £23 and t±2 > £23 (which correspond to 
replacing equality in Eq. (J10[) by < or >, respectively). In the former case, the above solutions 
for Pi(t) and p 2 (t) are valid until t = t\2- Afterwards, P\ 2 {t) = P\{t) = P2(t) satisfies Eq. © 
with I = 2, and solution 



Pl2@) 

The solution for p^{t) from 



1 



with (3 



2. 



2 + / 9e(*«-*)' P 1 (h2) 
remains valid until it meets with P\2(t), which happens at 
2p 3 (t ) 



t 



12|3 



*o + log 



1 -P 3 (*o 



This time can easily be calculated from the condition P3 1213) = |- 
In the remaining case, t±2 > £23, w e have 



P23W 



1 



2 + Pe^-^s) 



with (3 



p 3 (t 



2, 



2:! ; 
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after p 2 (t) and p 3 (t) met at t = t 23 , until p 23 (t) meets with p t (t) given in Eq. (JHJ) at time 

l-Pi(to) 



*1|23 = to + lo S 
(*1|2 

which the general situation is clear. 



2pi(*o) ' 

obtained from the condition Pi (^1123) = §■ Figure ^ shows a representative example, from 



6. Concluding Remarks 

Equilibria of smooth dynamical systems are usually reached only asymptotically. The 
above toy model does so in finite time, which is a consequence of the discontinuous right-hand 
side of If the latter were replaced by a smooth approximation (e.g., a sigmoid curve), 
neighbouring lines would no longer meet in finite time, but close in exponentially fast instead 
- otherwise, the qualitative picture remains the same. In particular, if (J2J) is considered 
with an odd function <p that is strictly monotonically increasing (hence including sigmoid 
curves), the nature of the globally stable equilibrium remains unchanged. An advantage of 
the discontinuous system is its exact solvability, including the calculation of all relevant time 
scales. 

As to the relevance of our findings for large, but finite systems, fluctuations can lead to 
violations of the order relation (JSJ). However, it is clear that the convergence to the equilibrium 
qualitatively remains the same if ./V is a multiple of M. Otherwise, the equilibrium is reached 
up to fluctuations of at most one individual per group, i.e., of order 1/N. This mirrors the 
deviations from the expectation values (over all realisations of the stochastic process), the 
latter coinciding with the equilibrium of the IPL limit in this simple case. 

It might be interesting to extend the above model by means of a stochastic (rather than 
deterministic) protocol, and to compare it with related models of game theory |lll H|. This will 
automatically lead to various extension and generalisations. To reach a more complete and 
realistic picture, it will be necessary to develop a proper stochastic frame and to investigate 
relevant finite size effects by suitable simulations, see also ^2] for a brief discussion of these 
issues. These two aspects will certainly require more attention in the future. 
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